Like you know when he left the building.
Try to keep up John, events don't happen in a vacuum, Oswald walked/ran up Elm street, Oswald caught a bus, Oswald got off the bus, Oswald walked/ran to the cab stand, Oswald traveled wayyy past his rooming house, Oswald was seen about 1PM by the housekeeper.
JohnM