It's only human nature to be attracted to many others. Even when you are in a relationship.
It is YOU who has to decide what YOU are looking for as you begin a relationship with another. If you want to be loyal to only one person you have to be prepared to make sacrifices.
If your intentions of a relationship is not serious with another, then you are just testing the waters, but under no circumstances is it very nice to mess with another's emotions.