Some parts of the story that never waver show signs of "sticking to a script"....eg the telling of the curtain rod excuse to LMR or the asking Oswald "what is in the package?" The idea that it was Rose and Stovall who detained him minutes after arriving at the hospital. This was patently untrue, the question is why lie about that?
Seeing Lee leave the TSBD after the shooting is just part of his evolving story. The real question is what is the true origin.
There is nothing I can find in his WC testimony that contradicts his affidavit. Obviously there is a lot more detail in his WC testimony regarding his personal relationship with Oswald etc. In terms of chronology his WC testimony ends with him having to go through the various checks before being allowed to go home.
We know his account of what happened after he left the TSBD is troublesome to say the least but this is not included in his earliest statements.
In his affidavit and WC testimony he states that after the shots he stood around for a few minutes then went back in the building. Any additions to that - wandering down towards the railroad tracks, seeing Oswald on Houston Street, seeing Mr Brown and his rifle - should be dismissed IMO.