Diffusion is not necessarily Spectral Autoregression