We simply keep track of the current estimate of the angle, and used that to switch to the most appropriate model for the next frame.
Here's an example of tracking a new sequence. It shows the model reconstruction superimposed on the original image (you can see the edge of the modelled region as a black line)
Tim Cootes