It doesn't.

Blood Moor has a lot of shrines, so the chance of finding a gem shrine there is rather high. Very often I find gem shrine in Blood Moor when I DON'T want to see one. (Dueling...)

Click the gem a lot of times and it will say Perfect Gem Activated..