That's the warlock trade off. You're the 1v1 Gods (assuming Paladins are.. changed) and your group role is basically just fear the annoying enemies, and use AoE on the fighting ones. (Your AoEs hurt.)

On the flip side, I perform better in a small group setting where I can actually use my diverse selection of abilities.