I'm terrified of heights, too. But I did ride in a balloon. It's unbelievably quiet. And there's no wind- you're going with the wind. Riding in a balloon is high enough to be high, but not too high. And it's slow enough to be enjoyable. You wouldn't think the ride would be that serene and peaceful.
If you get the chance, I would definitely urge you to take it.