I see the same behaviour. The Toolkit seems to cache when the cache is disabled. I just don't think it works. However there is a way to empty the cache, stop then start the Toolkit & the cache is empty. Very annoying during development however.