Oh no problem. In my mind it wasn't a physically consummated romance but instead an on and off of them being together just not putting it together themselves that both wanted more than their emotional companionship.
Sorta like neither were both 'on' at the same time as the other explaining how they could go years and years with other people and not get how much one means to the other.