Laura,
I sense that the attaction you are feeling is for what has not yet been explored. If you should get together with him the aforementioned problems could still begin to surface. People don't seem to change all that much.
It might be important to ask youself that if the potential relationship did not work out, would you be comfortable still being friends? Would it be possible to remain friends? Only you can decide if you feel that you can take that risk--
Best wishes,
