Surely there's someplace nearby?

I don't know where all the Loch's are in relation to Edinburgh, but a weekend holiday to one of them should allow you to cliff dive a bit? Albeit into cold water.

Alternatively, pay a visit to the Lake District. Lot's of lakes, and a lot of "cliffs". Best to do it when it's warm.