One more time

Or

Multi-pass techniques

And

Other stuff


Multi-pass techniques

When you render an object, you can define multiple rendering phases (called passes) with different attributes and different shaders to achieve more complex results.

How do we create one?
Simple, you just define another pass (just like your first one) after you close the pass. What was rendered in the first pass will be forwarded to next pass and so on.

technique
{
	pass pass1
	{
		…	
	}
	pass pass2
	{
		…
	}
	…
}

It’s Broken!

So, let’s begin. For the last chapter of part one, we will see some examples for how we can use what we learned so far to solve some simple problems you would likely encounter, and utilize them in multi-pass techniques.

First

If you’ve tried to blend any kind of model, you should have noticed you can see the other side of that object.
For instance:
Image

While in the sphere case this could easily be solved with culling, on more complex forms it will not. Observe:
Image

While there are no ‘real’ artifacts, we can see parts of the other side of the object which are facing the right direction.

The main problem in this case is that polygons from the other side pass the culling test. To solve this, we will need to filter them using the depth buffer.

…But how?
First off, we need a two pass technique:

technique
{
	pass pass1
	{	
		VertexShader = compile vs_1_1 VertexShaderFunction( );
		PixelShader = compile ps_2_0 PixelShaderFunction( );
	}
	pass pass2
	{
	}
}


Your instincts might tell you “opaque in first pass and blend in the second pass!”, if you do try this, you will see that the object will remain opaque.

Why?
Because during that pass, the object (not blending at all), “won” the Z buffer, sending only his pixels to the second pass.
Do not be fooled, the second pass will blend only with what the first had already sent – if the previous pass was opaque, blending performed by the second pass will generate no transparency to the background.

So, how CAN we solve this issue?
In order to allow us to reach a solution, we need somehow to write the object but not have it interact with the background until the second pass.
How? We will disable color-writing during the first pass.

How does this help?
By drawing the object without color-writing, you allow the depth buffer the filter out the back side of the object. Since in the first pass the object is opaque, the other side of it will fail the depth test.
All this is done without drawing the object to the screen, meaning the first pass will forward the background, and the object as 'invisible'.
This allows you to blend the originally opaque object with the background by enabling color-writing and blending in the second pass.

The solution:
(Remember, color-write 0 means off, and 7 means all channels on)

technique Technique1
{
	pass Pass1
	{	
		VertexShader = compile vs_1_1 VertexShaderFunction( );
		PixelShader = compile ps_2_0 PixelShaderFunction( );
		ColorWritEenable = 0;
	}
	pass pass2
	{
		ColorWritEenable = 7;
		alphablendenable = true;
		srcBlend = srcAlpha;
		destBlend= invSrcAlpha;
	}
}


Image
Hooray!
Thought color-write was useless have you?

Outline

If you sniff around, you will find all sorts of difficult edge detection techniques with all sorts of things you probably don’t want to mess around with at this point.

But say you want to draw just an outline around the object without any complex algorithms – how can you do that?

Again, this will be a two pass technique.

In order to achieve this result, we will use two sets of vertex + pixel programs. One will render an inflated version of the object, and the other a lighting technique.

technique Technique1
{
	pass Pass1
	{	
		VertexShader = compile  vs_1_1 backVS( );
		PixelShader = compile ps_2_0 backPS( );
	}
	pass Pass1
	{
		VertexShader = compile vs_1_1 lightingVS( );
		PixelShader = compile ps_2_0 lightingPS( );
	}
}


You will notice though, that in this state, the inflated will completely obscure the inner one, even if rendered first.

The first thing that comes to mind when attempting this is culling ccw in the outer layer and cw in the inner layer. In a sphere, this will work perfectly, in something more complex, it will not.
Image

You may try to render the inner layer first and then to render the outer layer while blending.
But doing that will create a ‘balloon’ around your inner part. While being a nice effect on its own, it’s not what we set out for.

Image
Did I mention I like yellow?
The balloon technique:

technique Technique1
{
	pass Pass1
	{	
		VertexShader = compile vs_1_1 lightingVS( );
		PixelShader = compile ps_2_0 lightingPS( );	
	}
	pass Pass1
	{
		cullmode = cw;
		alphablendenable = true;
		srcBlend = srcAlpha;
		destBlend= invSrcAlpha;
		VertexShader = compile vs_1_1 backVS( );
		PixelShader = compile ps_2_0 backPS( );	
	}
}



How can we do it than? You’ll be surprised; it’s even simpler than the balloon.

In order to solve this case, we will render the inflated layer first without Z-writing, and then enable Z-writing while rendering the inner layer;

technique Technique0
{
	pass Pass0
	{	
		ZWriteEnable = false;
		VertexShader = compile vs_1_1 backVS( );
		PixelShader = compile ps_2_0 backPS( );
	}
	pass Pass1
	{
		ZWriteEnable = true;
		VertexShader = compile vs_1_1 lightingVS( );
		PixelShader = compile ps_2_0 lightingVS( );
	}
}



The result:
Image

Why does it work?
The inflated layer cannot win, or contend, against other objects in front of it, while they are being written themselves.
But when the layer itself is written, depth check is still active, meaning the layer will pass its own pixels correctly compared to other objects in world space.

When the second, inner layer is computed, depth write is active, meaning it will immediately win the depth test against the outer layer, since it was not written at all into the buffer.

Drawbacks

While simple, this solution has its drawbacks – especially when blending.

In FXC, the object will render correctly at times while in other times not. The outer layer will blend with blending materials even when completely opaque and in front.

In OGRE, the problem is more consistent but none the less a problem. If a material is alpha blending in front of this object, you will see whatever resides behind it (meaning the blending ignores this technique’s pixels)

This problem is due to the fact the blending depends on source and destination pixels, which, in turn, depend on depth.

A better solution

The best solution to achieve this result is with the stencil buffer, though this is something we will not be touching at the moment (feel free to google it)

Additive lighting

Remember that long ugly shader we wrote to include more than a single point light with phong/blinn? Now we can make a better one using OGRE script. We can of course, do the same in FXC, but that requires some usage we haven’t learned yet (specifically, annotations and scripts).

We will use what is called ‘additive lighting’ – looping per light source and adding its contribution to the final color, using a simple shader that uses only one light source using additive blend.

Because of the nature of additive blend, we will first have to render either a black layer or an ambient only layer to prevent the scene from rendering with the object (basically rendering a 'canvas').

Currently, FXC cannot loop per light source; because of this we will use OGRE material script only, without an FXC example.

The foundation

The first part of this shader (as described above) is to render the base shape with a simple ambient color to prevent blending with the rest of the scene;
We will use the simplest shader possible to save computation time.

float4 baseAmbientVS(float4 pos : POSITION, uniform float4x4 worldViewProj_m ) : POSITION
{
	return mul(worldViewProj_m, pos);
}

float4 baseAmbientPS(uniform float4 ambientl) : COLOR 
{
	return ambientl;
}


For the second pass, we can use the multi-light type shader from chapter 10, and edit it to work on a single light:

struct vertexIn
{
	float4 position : POSITION;
	float3 normal	: NORMAL;
};
 
struct vertexOut
{
	float4 position  	: POSITION;
	float3 normal		: TEXCOORD0;
	float3 viewDir  	: TEXCOORD1;
	float3 pixelToLight	: TEXCOORD2;
};
 
// main vertex program
//--------------------------------------------------------------------------------
vertexOut multiTypeLightVS(	vertexIn 	input,
			uniform	float4x4 	worldViewProj_m,
			uniform	float4 		cameraPos,
			uniform	float4 		lightPos
			)
{
	vertexOut output= (vertexOut)0;
	
	output.position = mul(worldViewProj_m, input.position);
	output.normal 	= input.normal;
	output.viewDir	= cameraPos - input.position;
	
	if(lightPos.w == 0)
		output.pixelToLight = lightPos.xyz;
	else
		output.pixelToLight = lightPos - input.position;
	return output;
}
//--------------------------------------------------------------------------------
 
//main pixel program
//--------------------------------------------------------------------------------
float4 multiTypeLightPS(	vertexOut 	input,
			uniform float4		spotLightParams,
			uniform float3		lightDir,
			uniform	float4		diffColor,
			uniform	float4 		specColor,
			uniform float4		lightAtten,
			uniform float4		lightDist,
			uniform float		specShine
			) : COLOR
{
	float4 diff 	= float4(0, 0, 0, 0);
	float4 spec 	= float4(0, 0, 0, 0);
	
	input.viewDir	= normalize( input.viewDir );
	input.normal 	= normalize( input.normal );
	
	input.pixelToLight	= normalize( input.pixelToLight );
	
	float 	dotNL	 	= dot(pixelToLight, normal);
	float 	luminosity 	= 1 / ( lightAtten.y + lightAtten.z*lightDist + lightAtten.w*pow(lightDist,2));
	float3 	halfAng 	= normalize(viewDir + pixelToLight);
	float 	dotNH		= dot(normal, halfAng);
		
	// if spotlight params are (1, 0, 0, 1) we have a point, directional or empty light; we handle them the same.
	if(spotLightParams.x == 1 && spotLightParams.y == 0 && spotLightParams.z == 0 && spotLightParams.w == 1)
	{
		spec	+= pow(saturate(dotNH),specShine) * specColor * luminosity;
		diff 	+= (saturate(dotNL)) * diffColor * luminosity;		
	}
	else
	if(dotNL > 0)
	{	
		//if it was not either of the above, we have a spotlight
		float 	dotPLd		= dot(-pixelToLight, spotLightDir);
		//diffuse
		//------------------------------
		if	( dotPLd > spotLightParams.y )
			diff += dotNL * (1-(spotLightParams.x - dotPLd)/(spotLightParams.x - spotLightParams.y)) * diffColor * luminosity;
		else
		if	( dotPLd > spotLightParams.x )
			diff += dotNL * diffColor * luminosity;	
		//------------------------------

		// specular
		//------------------------------
		if (dotPLd > 0) 
			spec 	+= pow(saturate(dotNH),specShine) * specColor * luminosity;
		//------------------------------
	}
			
	return diff + spec ;
}
//--------------------------------------------------------------------------------

The material

In order to iterate over lights, we use the iteration rule command.
In our case, we will use the once_per_light rule, but do read about it in the OGRE manual.

So, our material will have two vertex programs, and two pixel program:

  • Base ambient VS/PS
  • multiTypeLight VS/PS (lightMasterB_VS/PS)


The first pass will render the object with only the ambient color, and the second with all available lights. Although the Phong shader does receive an ambient color, we will send an empty color to it. If not, the ambient will be contributed multiple times.

The second pass will use additive blending (to keep the previous pass’s results) and an iteration rule.

It should look something like this:

vertex_program baseAmbientVS hlsl
{
	source baseAmbient.hlsl
	entry_point baseAmbientVS
	target vs_1_1
	default_params
	{
		param_named_auto 	worldViewProj_m 	worldviewproj_matrix
	}
}

fragment_program baseAmbientPS hlsl
{
	source baseAmbient.hlsl
	entry_point baseAmbientPS
	target ps_2_0
}

vertex_program lightMasterB_VS hlsl
{
	source lightmaster2.hlsl
	target vs_1_1
	entry_point multiTypeLightVS
	default_params
	{
		param_named_auto 	worldViewProj_m 	worldviewproj_matrix
		param_named_auto	cameraPos		camera_position_object_space
		param_named_auto	lightPos		light_position_object_space 0
	}
}

fragment_program lightMasterB_PS hlsl
{
	source lightmaster2.hlsl
	target ps_2_0
	entry_point multiTypeLightPS
	default_params
	{
		param_named_auto	lightDir		light_direction_object_space 0 
		param_named_auto	spotLightParams		spotlight_params 0
		param_named_auto	diffColor		light_diffuse_colour 0
		param_named_auto	specColor		light_specular_colour 0
		param_named_auto	lightAtten		light_attenuation 0 
		param_named_auto	lightDist		light_distance_object_space 0 
	}
}

material lightMasterB
{
	technique
	{
		pass
		{
			vertex_program_ref baseAmbientVS { }
			fragment_program_ref baseAmbientPS { }
		}
		pass
		{
			iteration once_per_light 
			scene_blend add
			vertex_program_ref lightMasterB_VS {}
			fragment_program_ref  lightMasterB_PS 
			{
				param_named specShine float 55
			}
		}
	}
}

Note that:
• I sent some of the information to the programs in the pass. This is because it’s a specific implementation, and not a constant rule of action (world-view-projection will never defer, but the desired shininess of the specular might)
• I used the shader the same way I would have used it without the iteration for a single light
• Scene blend add (vital…)

WOOHOO

you finished part one of the guide!

<HR>
Creative Commons Copyright -- Some rights reserved.


THE WORK (AS DEFINED BELOW) IS PROVIDED UNDER THE TERMS OF THIS CREATIVE COMMONS PUBLIC LICENSE ("CCPL" OR "LICENSE"). THE WORK IS PROTECTED BY COPYRIGHT AND/OR OTHER APPLICABLE LAW. ANY USE OF THE WORK OTHER THAN AS AUTHORIZED UNDER THIS LICENSE OR COPYRIGHT LAW IS PROHIBITED.

BY EXERCISING ANY RIGHTS TO THE WORK PROVIDED HERE, YOU ACCEPT AND AGREE TO BE BOUND BY THE TERMS OF THIS LICENSE. THE LICENSOR GRANTS YOU THE RIGHTS CONTAINED HERE IN CONSIDERATION OF YOUR ACCEPTANCE OF SUCH TERMS AND CONDITIONS.

1. Definitions

  • "Collective Work" means a work, such as a periodical issue, anthology or encyclopedia, in which the Work in its entirety in unmodified form, along with a number of other contributions, constituting separate and independent works in themselves, are assembled into a collective whole. A work that constitutes a Collective Work will not be considered a Derivative Work (as defined below) for the purposes of this License.
  • "Derivative Work" means a work based upon the Work or upon the Work and other pre-existing works, such as a translation, musical arrangement, dramatization, fictionalization, motion picture version, sound recording, art reproduction, abridgment, condensation, or any other form in which the Work may be recast, transformed, or adapted, except that a work that constitutes a Collective Work will not be considered a Derivative Work for the purpose of this License. For the avoidance of doubt, where the Work is a musical composition or sound recording, the synchronization of the Work in timed-relation with a moving image ("synching") will be considered a Derivative Work for the purpose of this License.
  • "Licensor" means the individual or entity that offers the Work under the terms of this License.
  • "Original Author" means the individual or entity who created the Work.
  • "Work" means the copyrightable work of authorship offered under the terms of this License.
  • "You" means an individual or entity exercising rights under this License who has not previously violated the terms of this License with respect to the Work, or who has received express permission from the Licensor to exercise rights under this License despite a previous violation.
  • "License Elements" means the following high-level license attributes as selected by Licensor and indicated in the title of this License: Attribution, ShareAlike.

2. Fair Use Rights

Nothing in this license is intended to reduce, limit, or restrict any rights arising from fair use, first sale or other limitations on the exclusive rights of the copyright owner under copyright law or other applicable laws.

3. License Grant

Subject to the terms and conditions of this License, Licensor hereby grants You a worldwide, royalty-free, non-exclusive, perpetual (for the duration of the applicable copyright) license to exercise the rights in the Work as stated below:

  • to reproduce the Work, to incorporate the Work into one or more Collective Works, and to reproduce the Work as incorporated in the Collective Works;
  • to create and reproduce Derivative Works;
  • to distribute copies or phonorecords of, display publicly, perform publicly, and perform publicly by means of a digital audio transmission the Work including as incorporated in Collective Works;
  • to distribute copies or phonorecords of, display publicly, perform publicly, and perform publicly by means of a digital audio transmission Derivative Works.
  • For the avoidance of doubt, where the work is a musical composition:
    • Performance Royalties Under Blanket Licenses. Licensor waives the exclusive right to collect, whether individually or via a performance rights society (e.g. ASCAP, BMI, SESAC), royalties for the public performance or public digital performance (e.g. webcast) of the Work.
    • Mechanical Rights and Statutory Royalties. Licensor waives the exclusive right to collect, whether individually or via a music rights society or designated agent (e.g. Harry Fox Agency), royalties for any phonorecord You create from the Work ("cover version") and distribute, subject to the compulsory license created by 17 USC Section 115 of the US Copyright Act (or the equivalent in other jurisdictions).
    • Webcasting Rights and Statutory Royalties. For the avoidance of doubt, where the Work is a sound recording, Licensor waives the exclusive right to collect, whether individually or via a performance-rights society (e.g. SoundExchange), royalties for the public digital performance (e.g. webcast) of the Work, subject to the compulsory license created by 17 USC Section 114 of the US Copyright Act (or the equivalent in other jurisdictions).


The above rights may be exercised in all media and formats whether now known or hereafter devised. The above rights include the right to make such modifications as are technically necessary to exercise the rights in other media and formats. All rights not expressly granted by Licensor are hereby reserved.

4. Restrictions

The license granted in Section 3 above is expressly made subject to and limited by the following restrictions:

  • You may distribute, publicly display, publicly perform, or publicly digitally perform the Work only under the terms of this License, and You must include a copy of, or the Uniform Resource Identifier for, this License with every copy or phonorecord of the Work You distribute, publicly display, publicly perform, or publicly digitally perform. You may not offer or impose any terms on the Work that alter or restrict the terms of this License or the recipients' exercise of the rights granted hereunder. You may not sublicense the Work. You must keep intact all notices that refer to this License and to the disclaimer of warranties. You may not distribute, publicly display, publicly perform, or publicly digitally perform the Work with any technological measures that control access or use of the Work in a manner inconsistent with the terms of this License Agreement. The above applies to the Work as incorporated in a Collective Work, but this does not require the Collective Work apart from the Work itself to be made subject to the terms of this License. If You create a Collective Work, upon notice from any Licensor You must, to the extent practicable, remove from the Collective Work any credit as required by clause 4(c), as requested. If You create a Derivative Work, upon notice from any Licensor You must, to the extent practicable, remove from the Derivative Work any credit as required by clause 4(c), as requested.
  • You may distribute, publicly display, publicly perform, or publicly digitally perform a Derivative Work only under the terms of this License, a later version of this License with the same License Elements as this License, or a Creative Commons iCommons license that contains the same License Elements as this License (e.g. Attribution-ShareAlike 2.5 Japan). You must include a copy of, or the Uniform Resource Identifier for, this License or other license specified in the previous sentence with every copy or phonorecord of each Derivative Work You distribute, publicly display, publicly perform, or publicly digitally perform. You may not offer or impose any terms on the Derivative Works that alter or restrict the terms of this License or the recipients' exercise of the rights granted hereunder, and You must keep intact all notices that refer to this License and to the disclaimer of warranties. You may not distribute, publicly display, publicly perform, or publicly digitally perform the Derivative Work with any technological measures that control access or use of the Work in a manner inconsistent with the terms of this License Agreement. The above applies to the Derivative Work as incorporated in a Collective Work, but this does not require the Collective Work apart from the Derivative Work itself to be made subject to the terms of this License.
  • If you distribute, publicly display, publicly perform, or publicly digitally perform the Work or any Derivative Works or Collective Works, You must keep intact all copyright notices for the Work and provide, reasonable to the medium or means You are utilizing: (i) the name of the Original Author (or pseudonym, if applicable) if supplied, and/or (ii) if the Original Author and/or Licensor designate another party or parties (e.g. a sponsor institute, publishing entity, journal) for attribution in Licensor's copyright notice, terms of service or by other reasonable means, the name of such party or parties; the title of the Work if supplied; to the extent reasonably practicable, the Uniform Resource Identifier, if any, that Licensor specifies to be associated with the Work, unless such URI does not refer to the copyright notice or licensing information for the Work; and in the case of a Derivative Work, a credit identifying the use of the Work in the Derivative Work (e.g., "French translation of the Work by Original Author," or "Screenplay based on original Work by Original Author"). Such credit may be implemented in any reasonable manner; provided, however, that in the case of a Derivative Work or Collective Work, at a minimum such credit will appear where any other comparable authorship credit appears and in a manner at least as prominent as such other comparable authorship credit.

5. Representations, Warranties and Disclaimer

UNLESS OTHERWISE AGREED TO BY THE PARTIES IN WRITING, LICENSOR OFFERS THE WORK AS-IS AND MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND CONCERNING THE MATERIALS, EXPRESS, IMPLIED, STATUTORY OR OTHERWISE, INCLUDING, WITHOUT LIMITATION, WARRANTIES OF TITLE, MERCHANTIBILITY, FITNESS FOR A PARTICULAR PURPOSE, NONINFRINGEMENT, OR THE ABSENCE OF LATENT OR OTHER DEFECTS, ACCURACY, OR THE PRESENCE OF ABSENCE OF ERRORS, WHETHER OR NOT DISCOVERABLE. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO SUCH EXCLUSION MAY NOT APPLY TO YOU.

6. Limitation on Liability.

EXCEPT TO THE EXTENT REQUIRED BY APPLICABLE LAW, IN NO EVENT WILL LICENSOR BE LIABLE TO YOU ON ANY LEGAL THEORY FOR ANY SPECIAL, INCIDENTAL, CONSEQUENTIAL, PUNITIVE OR EXEMPLARY DAMAGES ARISING OUT OF THIS LICENSE OR THE USE OF THE WORK, EVEN IF LICENSOR HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

7. Termination

  • This License and the rights granted hereunder will terminate automatically upon any breach by You of the terms of this License. Individuals or entities who have received Derivative Works or Collective Works from You under this License, however, will not have their licenses terminated provided such individuals or entities remain in full compliance with those licenses. Sections 1, 2, 5, 6, 7, and 8 will survive any termination of this License.
  • Subject to the above terms and conditions, the license granted here is perpetual (for the duration of the applicable copyright in the Work). Notwithstanding the above, Licensor reserves the right to release the Work under different license terms or to stop distributing the Work at any time; provided, however that any such election will not serve to withdraw this License (or any other license that has been, or is required to be, granted under the terms of this License), and this License will continue in full force and effect unless terminated as stated above.

8. Miscellaneous

  • Each time You distribute or publicly digitally perform the Work or a Collective Work, the Licensor offers to the recipient a license to the Work on the same terms and conditions as the license granted to You under this License.
  • Each time You distribute or publicly digitally perform a Derivative Work, Licensor offers to the recipient a license to the original Work on the same terms and conditions as the license granted to You under this License.
  • If any provision of this License is invalid or unenforceable under applicable law, it shall not affect the validity or enforceability of the remainder of the terms of this License, and without further action by the parties to this agreement, such provision shall be reformed to the minimum extent necessary to make such provision valid and enforceable.
  • No term or provision of this License shall be deemed waived and no breach consented to unless such waiver or consent shall be in writing and signed by the party to be charged with such waiver or consent.
  • This License constitutes the entire agreement between the parties with respect to the Work licensed here. There are no understandings, agreements or representations with respect to the Work not specified here. Licensor shall not be bound by any additional provisions that may appear in any communication from You. This License may not be modified without the mutual written agreement of the Licensor and You.