Most people have not experienced anywhere near that level of divinity in this life. Nor is it taught in mainstream religions. To be afraid of it, firstly you have to know what it is. So you'd firstly need to be aware of the ignorance covering it and that is most difficult as the world is geared to not let you be great or divine. You can't even expand your creativity without hitting walls! LOL.
On a different level, when an initiate gets close to the love of the Divine, or the Divine within themselves, they are really afraid of the fire. The backlash is usually very difficult to hold. To remain in ones greatness, is to be transpersonal, and not effected by the world around them, this includes family and friends, authority figures who think they know better and anyone else who has an agenda to stay at the top of the food chain.
There is Divinity within for sure, but reaching it is no mean feat, and then retaining it is more difficult - depending on your circumstances.
Interestingly, there is a Hindu story where two initiates wanted enlightenment, they begged to see the Guru in order to get it. The Guru gave them a date and time and when the meeting was due, the two students were seen running with their suitcases. Fire burns, it's usually our little minds that are afraid of it and are completely ignorant of what it means.