Says who? Besides the cab driver whose statements are in question who saw Oswald take the cab?
Not only that, but even if Oswald did take a cab, who says he intended to go directly to the rooming house when he got in the cab?
This is just another one of those “X seems to me like something a guilty person would do” arguments, which is rhetoric, not evidence.