When you stagger out of stuff, you do have to make sure you are holding guard as you are doing it within the already stun duration.
To also note that stagger escaping does not help for most situations, otherwise it would be too powerful. If you stagger out a move that's like +27 and left you...