Exactly, I also want to have private browsing but with persistent history. I'm using Self-Destructing Cookies [1] for that; you can also white-list some domains there for eg. keep me logged in. But would love to have the container as you describe for that.

[1] https://addons.mozilla.org/pl/firefox/addon/self-destructing...