Absolutely not. Right now mine is about as low as it gets, and the reason mine is low is because I've published several hubs over the past few days - and published them quickly.
When you publish something quickly it's nearly always going to start it's life with a low score, and that will then bring your average for all hubs down, which in turn brings your author score down.
That stuff is all going to rise though - no big deal.
Another thing - I've hit the "follow" button on several person's profiles lately because they either commented or followed me, and after looking over some of their content - it looked like a good idea to follow them as well.
I'm fairly certain that following a large number of persons keeps my score lower - but guess what? I don't care. I'm here to make some money at this point, momma needs a new pair of shoes.