Even worse; it's only an assumption that Oswald wore the same shirt he was arrested in at the TSBD that morning.
Marina testified that she thinks that was the shirt he wore that morning. Bledsoe testified it was the same shirt.
The image of the funny-looking guy not resisting arrest

outside the TT shows the same color shirt (lightened by the sunshine)