Even if you hold it, it takes the game longer than 4 frames to restart the Zeal sequence. Just watch him when he does it.

Also, max damage charms really aren't worth it anymore. If you have 10x +14 max dmg GC's and 10x +3 max dmg SC's, you're only adding 170 max damage to your final damage. I'd rather have something more useful.