The only thing my father and I have in common is that our similarities are different.
The similarities between me and my father are different.
You can't compare me to my father. Our similarities are different.