"The product of their ages is 36".
When I still couldn't find their ages he said:
"Ok. I'll give you another clue: the sum of their ages is same as the number of my house".
I knew the number but still couldn't calculate their ages. So the man gave me a last hint, he said:
"My eldest daughter lives upstairs".
Finally I was able to find their ages. Can you?