Honesty is the best policy....if done early.

I don't think its wrong to be true to your feelings.

But you probably should have done it earlier. It will reduce the damage.