Even if only 1 were on it, that's 3%. Misery gives you the whole thing immediately, so I don't see what that has to do with anything. In any case, in combination, that's an 8% damage increase just by putting up SW:P; I don't see why you'd want to miss out on that.