If this is your first child, it is not an easy call because of your lack of experience. It is important to stay calm and observe. Your baby needs your calm. I took my first child to the doctor far to many times but she was so precious and I didn't know what to do. Teething is real tricky.
My motto is -- it is better to be safe than sorry.