I am not sure I understand where you are going with your question, but I will answer as best I can.
You are obviously talking about 'Phileo' love, person to person, and not person to God or vice versa. The bible says this in 2 Corinthians 1:9 : "But we had the sentence of death in ourselves, that we should not trust in ourselves, but in God which raiseth the dead:"
So, if the Scripture say that there are times when we should not trust even in ourselves, then I think when we say " I love you" to someone we should pay close attention to where they put their trust (hopefully in God first). That would tell us whether they are worthy of our trust.