It's far more common that you just want to give an answer than that you want to get emails about the answers of others. I think the option to follow a question should be unchecked by default (or at least make it a configurable setting).
Yesterday we released this feature in response to users who requested it. However, it looks like we made a mistake: unlike our previous notification checkboxes, this feature does not remember your last selection. I will add it to my task list.