You can totally take your shit wherever you want. I assume you take it with you in a bag.
Personally, I'm not fond of taking my shit with me, I tend to leave my shit. Sometimes I even flush my shit.
You'll come out lighter if you leave your shit.
But hey, you do you.