I would say only if you start following every person that asked a question. Participating in the community is usually only reflected positively in your hub score.... however, no one really knows the precise calculation for the scores. However, it could be impacted by someone who didn't like something you wrote and voted your hub down. That would be my guess anyway.
PS - I haven't checked out your hubs so this is by no means because I think you wrote a bad hub... I am going to go check them out now :)