Yes it is to do with density. Just as TAS is greater than IAS with increasing altitude as density reduces, as density decreases below that of ISA SL TAS will be lower than IAS.
IAS proportional to 1/2 rho (density) V2 (TAS squared)