persisting buffs

So I am trying to do a Berserker build. I also use Static Touch with Empower and Fortify. I find it disheartening that when I leave onto a new screen, EP depletes all the way to Zero. Also Potion buffs, Static Touch, and Utility buffs fall off. Is this supposed to happen? If I am grinding...