Stop the context so the refresh loop terminates on restart.

Fixes: #3815
Signed-off-by: Miek Gieben <miek@miek.nl>