Short answer is religious programming, often the result of generations with the same mindset who have preceded them. Ignorance, as you have mentioned, plays a huge role, especially when any type of exploration into our innate spiritual gifts and abilities is involved. Religion, as we know in the west, has a long track record of brutally discouraging any who "dabbled" in the arts, equating it with being in league with the devil. Religion was designed to be a cohesive factor in bringing together both similar and diverse groups of people under a common banner, where each was essentially forced to accept the "truth" being preached by rabbis, imam or ministers. They did not want their "sheep" looking for insight or understanding from any source but them.
What is quite ironic is that in every Christian home I know they celebrate a birthday by blowing out birthday candles. This is merely a simplified version of candle magic.