Those things are expected to due huge amounts of damage. But, when you think about 'water', it's really harmless.
But, when HUGE amounts of accumulate and slam down on top of people, it becomes such a destructive force. It gives people pause.
Meteors and Volcanos are powerful to begin with and extremely dangerous compare to water.