Do not close them when they are maximized.
Adjust them to a windowed (sized) instance before closing them.
See if that let's them stay closed when you close them.
I thought that they (Microsoft) had addressed this issue in a recent update. Maybe it was re-introduced.
Want to reply to this thread or ask your own question?
You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.