Constraining the spectral age of very asymmetric CSOs. Evidence of the influence of the ambient medium