The countess is in Act 1 Black Marsh. You have to kill her as a quest, and you go to the Tower place in Black Marsh. You kill her and she normally drops 2-3 runes and some other goodies, not to mention all the chests and unique monsters on the way down.