Don't worry; it doesn't destroy any health properties as sugar doesn't contain a high content of minerals.
Some minerals don't go well together, such as calcium and iron, yet sugar is a pure condement, it won't have any effect.
Make sure you use a deep brown sugar, as it is significantly healthier than sweetner or white sugar.
Also; white tea (I think it's the root of green tea?) is even better health wise then green, yet it's ten times more bitter.