Hi, I'm Elise, a fellow user like yourself and I'd be happy to help with your issue.
Does it work if you don't force quit? As far as I understand about this feature it simply kills the process for Edge, so it won't give it a chance to run these cleanup routines on shut down.
Kind Regards,
Elise